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(54) Using database query technology for message subscriptions in messaging systems 



(57) The present invention relates to messaging 
systems in general and message broker systems in 
spedfla More particutarty, the invention relates to 
means and a method for processing message publica- 
tion requests and message subscription requests. 

The current invention transforms the suk)scrlption 
problem into a database query profcHem allowing to use 
query techniques known and optimized for many years. 
The basic approach of the current invention is to invert 
the relatk>nship of message publicatton requests 
(treated as database data) and message sul^scription 
requests (treated as database queries) according the 
state of the art Thus the core of the current invention is 
to treat incoming messages publication requests as 
database queries and to treat message subscriptkHi 
requests as database queries. 
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Description 

1 Background of the Invention 

1 .1 Reld off the Invention s 

[0001] The present invention relates to messaging 
systems in general and message t>rokers in specific. 
More particularly, the invention relates to means and a 
method for processing message publication requests io 
and message subsaiption requests. 

1.2 Description and Disadvantages of Prior Art 

[0002] One source of technology the current invention is 
is based on is the database technology. For a thorough 
outline of the principles and concepts of database tech- 
nology refer for instance to R. Elmasri and S.B. Nav- 
athe, Fundamentals of datat>ase systems, 1989. 
Benjamin/Cummtngs. Of specific importance to the cur- 20 
rent invention is the fundamental concept of a query of 
database technology. A query is a request to a data- 
base system to retrieve from a database a collection of 
data qualifying under the query; this ooHectton is called 
the ans^r set of the query. Typically, the database con- 25 
tains data about real-world entities like persons, orders, 
appointments etc.. A query is a prescription for select- 
ing subsets from these entities, possibly combine some 
of them, and present them in a certain fbnn. 
[0003] Another source of technology the current 30 
inventkm is based on is the technology messaging sys- 
tems or message brokers in specific. A messaging sys- 
tem or a message broker is like a hub where messages 
are streaming in, are transformed, and are streaming 
out Messaging systems offer the passing of messages 35 
through a store-store-and-foravard fundonality. Mes- 
sage brokers in addition also allow to reduce the con- 
nection costs by supporting the many-to-many 
communication principle comprising the one "source- 
message** vs. multiple "sink-message** communication 40 
case. Compared to messaging systems a message bro- 
ker might be augmented by related services Hke: a mes- 
sage transformer, ffow controller, message warehouse, 
message dkiionary and management facility. 
[0004] The messages which are streaming into the 45 
messaging systern/k)roker are referred to as k>eing put>- 
lished. Messages which are streaming out of the mes- 
saging 8ysten)A>roker are referred to as being 
subscn'bed. A pubTication request specifies a message 
a certain appficatfon intends to offer to other interested so 
appfications, i.a to sii)scrft)ers. A sut)script!on request 
specifies the subset of all incoming messages a partic- 
ular application is interested in. and the format in which 
it has to be presented to the subscriber. An overview on 
messaging systems and message t>rokers is given in R. 55 
Schulte. Message brokers: A fbcussed approach to 
appfication integratfon. Gartner Group, Strategic Analy- 
sis Report SSA R-401-102. 1996 as well as in **Enter- 



prtse applicatfon integratfon and infonnation ffow". The 
V^nkee Group - Internet Computing Strategies (Boston 
MA. 1997). 

[OOOq Thi^ a subscription request similar to what 
has been described at>ove as a **query'* in terms of data- 
base technology. And exactly in this sense current state 
of the art messaging systems and message brokers do 
treat subscription requests. Expressed in database 
terms the "messages" are treated as *'database data" 
arxJ the "sut^scriptions request" are treated as "query" 
operating on that data f atering out the subscribed mes- 
sages; i.e. based on its specffication messages are fil- 
tered, transformed and delivered to its requester. State- 
of-the-art implementations (for instance the Gryphon 
approach of IBM Watson Research) use techniques like 
variants of binary trees to represent suk)scription 
requests and process incoming messages accordingly 
for filtering. 

[0006] So tar soedfic implementations for messaging 
systems and message brokers of tiiese administrations 
and filtering tasks of message pukslication and subscrip- 
tion requests have been required. No exploitation of 
general purpose technofogies delivering performant 
solutions has been possible so far. 
[0007] The message broker paradigm is about to gain 
increased importance In the area of application integra- 
tion. Hs implementation therefore has to be further 
improved to be able to support the huge diversity of 
application needs. 

1 .3 Objective off the Invention 

[0008] The invention is based on the objective to 
improve the processing of message publication 
requests and message sid>scription requests within 
messaging systems in general and message brokers in 
spedfic. 

2 Summary and Advantages off the Invention 

[0009] The objective of the invention is solved by tiie 
independent claims. 

[001 0] The objective of the invention is solved by daim 
1 . A messaging system is taught comprising first recc- 
ing means for receiving a message pi^ication request 
comprising a message to be piMshed. Saki messaging 
system comprising second receiving means for receiv- 
ing one or a multitude of message sut>scription requests 
comprising a query on a message qualifying under said 
query. Further a datat>ase (301 ) is comprised. SakJ sec- 
ond receiving means treats said message subscription 
request as database data and stores said message 
sut}scription request to sakJ database (301). Said first 
receiving means treats said message publication 
request as a datat)ase query (302) arxl retrieves from 
said datat>ase a collection (303) of message subscrip- 
tion requests qualifying under saki database query 
[0(H 1) The technxiue proposed by the current inven- 
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tion makes database technology available to messaging 
systems. In database environments a query operates 
on a large anx)unt of data, but in a message broker 
environment a large amount of queries (con'esponding 
to a message subscription) operate on a single data 5 
item (corresponding to a publicatk>n of a message). Due 
to this ctrcumstances database technology coukJ not be 
expk>ited in a perfbrmant manner by messaging sys- 
tems. Moreover the current teaching signif cantly simpli- 
fies the implementation of messaging systems as an fo 
exploitation of the mature, sophisticated and high per- 
formant database technology is possible: no implemen- 
tation specific to messaging systems is required. 
Through the transformation of the subscription problem 
into a datai>ase query problem the current inventk)n ts 
allows to use query techniques known and optimized for 
many years. All advantages and benefits provided by 
database technology are immediately availat)le to mes- 
saging systems, like persistency, recovery features, 
transactional behavbr and many more. For a broad 20 
spectrum of business problems, no new algorithms 
must be invented and existing implementations can be 
reused. All these advantages are of specific value within 
messages systems required to provide high reliability 
against data losses and high availability 25 
[0012] Additional advantages are accomplished by 
claim 2. According to a further embodiment of the pro- 
posed invention said second receiving means trans- 
forms a message subsoptwn request into a database 
data representation. 30 
[001 3] By explicitly transforming a message subscrip- 
tion into a specific data representation the efficiency (for 
instance in terms of the amount of data to be stored or 
in terms of performance to process a later query for that 
data etc.) of the cunrent approach can be inaeased fur- 3s 
ther. 

[0(M4] Additional advantages are accomplished by 
claim 3. According to a further embodiment of the pro- 
posed invention sakJ first receiving means transform 
said message pubfication request into a database 40 
query. 

[0015] Through such a transformation, which may k>e 
adjusted to the transformation of the subscription 
according to daim 2. into a spedTic query representa- 
tion tiie efficiency of the cunrent approach can be 4S 
increased further. 

[0016] Additional advantages are accomplished by 
daim 4. According to a further embodiment of the pro- 
posed invention saki first recehnng means store said 
message into sakJ database or into a separate message so 
database. 

[0017] Using database technology also for the mes- 
sages allows to profit from the database technofogy 
benefits for the message request too: examples are: the 
recovery features after system crashes, atomicity, integ- ss 
rity eta. Moreover through this feature the door to mes- 
sage warehousing is opened. 
IQ018] Additional ad^/antages are accomplished by 



daim 5. According to a furtfter embodiment of tiie pro- 
posed invention the current teaching applied to a 
message broker and/or a message warehouse 
[0019] Through its universality tiie offrent teaching 
may be applied in various areas. 
[0020] Additional advantages are accomplished by 
daim 6. 

[0021 ] According to a furtiier embodiment of the pro- 
posed invention sakI database may be stored in main 
memory and/or on persistent memory. 
[0022] Again this demonstrates the flexibility of ttie 
teaching; messaging systems, for which ttie response 
time t>ehavior is tiie primary requirement and which will 
store the database within main memory, as weD as mes- 
sages systems, for which retiabOity against data fosses 
is the primary requirement and which will store the data- 
base on persistent memory, may exptoit the proposed 
technology 

[0023] Additional advantages are accomplished by 
daim 7. According to a further embodiment of tiie pro- 
posed invention sakf database may be a relational data- 
base or a hierarchical datat)ase or a network datat>ase 
or an object-oriented database or a collection of flat 
fOes. 

[0024] Thus the current teaching is applicable to any 
type of datak>ase. The teaching does not limit tiie 
exploiter to a certain database technology; instead 
ottier aiteria, for instance maturity, availability of the 
database techndogy or ttie type of data to be stored 
within the database, may dedde on tiie database type 
to be selected. 

[0025] Additional advantages are accomplished by 
daim 8. According to a furtiier embodiment of tiie pro- 
posed invention tiie messaging system is comprising 
sending means tor sending said message to subscrib- 
ers of said collection of message subscription requests. 
[0026] Thus the message comprised in the message 
publication request and serving as the datat)ase query 
can finally be sent to all subscribers of fliat particular 
message or that message type. 
[0027] The objective of the invention is solved by daim 
9. 

[0028] A metfiod of processing a message publ»ation 
request is being taught comprising a message to be 
published, and one or a nruiltitude of message-subscrip- 
tion-requests comprising a query on a message qualify- 
ing under said query. SakJ method comprises the 
following steps: 1) a first step of treating saM message 
sut>scription request as datat>ase data and storing sakJ 
message sut)soription request to sakJ datat)ase (301), 
and 2) a second step of treating said message put)lica- 
tion request as a datat)ase query (302) and retrieving 
from saki dataliase a cdlection (303) of message sut>- 
scription requests qualifying under sakI datak>ase- 
query 

[0029] Benefits related to this teaching have been cfis- 

cussed togetiier wrtti daim 1 abova 

[0030] Additional advantages are accomplished i>y 
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ciaim 10. AcocmllngtoaftjilhereiTtbcxfuiientGlt^^ 
posed invention said first step is preceded tiy a sub- 
scrqytion transformation step wherein said message 
sut)scription request Is transformed into a database 
data representation. 

[0031 ] Benefits related to this teaching have been dis- 
cussed together with claim 2 above 
[0032] Additional advantages are accomplished by 
claim 1 1 . According to a further embodiment of the pro- 
posed invention said second step is preceded by a mes- 
sage transformation step wherein said message 
publicatfon request Is transformed into a database 
query. 

[0033] Benefits related to this teaching have been dis- 
cussed together with daim 3 above. 
[0034] Additional advantages are accomplished by 
claim 1 2. According to a further embodiment of the pro- 
posed inverrtion said first step stores said message into 
said datat^ase or into a separate message database. 
[0035] Benefits related to this teaching have been dis- 
cussed together with daim 4 above. 
[0036] Additional advantages are accomplished by 
daim 1 3. According to a further embodiment of the pro- 
posed invention said method is executed by a message 
broker and/or wherein said database is part off a mes- 
sage warehouse. 

[0037] Benefits related to this teaching have been dis- 
cussed together with daim 5 above. 
[0038] Additional advantages are accomplished 
claim 14. According to a further embodiment of the pro- 
posed invention said method is storing said database in 
main menrxMry and/or on persistent menxMy. 
[0039] Benefits related to this teaching have been dis- 
cussed tog^er with daim 6 above. 
[0040] Additional advantages are accomplished by 
claim 1 5. According to a further embodiment of the pro- 
posed invention said datat>ase is a relational database 
or a hierarchical datat)ase or a network datat>ase or an 
object-oriented databasa 

[0041 ] Benefits related to this teaching have been dis- 
cussed together with daim 7 above. 
[0042] Additional advantages are accomplished by 
daim 1 6. According to a further embodiment of the pro- 
posed invention said method Is further comprising a 
third step of sending saki message to sutiscribers of 
saSd collectfon of message sut>scriptfon requests. 
[0043] Benefits related to this teaching have been dis- 
cussed together with daim 8 above. 

3 Brief Description of ttie Diawfngs 

[0044] 

Figure 1 is a diagram reflecting the query concept 
according database technology 

Hgure 2 visualizes the relatfonshp and the handling 
of message put)licatk>n requests and mes- 
sage subscnptfon requests according to 



the current state of the art of messaging 
systems 

Rgure 3 depicts the relaticvtship and the handling of 
message put)iication requests and mes- 
s sage subscription requests according to 

the current invention and applicability of 
database technology 

4 Description of the Pref^nred Embodiment 

10 

[0045] If the current specification is referring to a data- 
base ths tenn indudes any type of datal>ase system, 
like for example relational databases, hierarchical data- 
base, networi^ databases or object-oriented databases; 

15 the invention is not limited to a specific database system 
type. Moreover for the sake of the cunrent invention the 
data model of the database system is irrelevant. Also, 
the database system might manage persistent data on 
disk and/6r might manage data in main memory (i.a a 

20 main memory database). 

[0046] This teaching does not impose any limitatons 
to the nature of a message or the type of subscription. 
Moreover the term "message" is to be understood from 
a logfoal perspective. The actual convmirtication nid- 

25 dieware may transfer the message using the connec- 
tion-oriented or the connectionless paradigm; the 
invention is not limited to any of these paradigms. 
[0047] The cunrent invention relates to messaging sys- 
tems as well as message brokers. Therefore if features 

30 of the invention are described within this specif ication in 
the context of message brokers only the teaching may 
also be applied to messaging systems and vice versa, 

4.1 introduction 

35 

[0048] Of specific importance to the cunent invention 
^ the fundamental concept of a query of datat)ase 
technology, which is depicted in Figure 1 . A query (101) 
is a request to a database system to retrieve from a 

40 database (1 02) a collection of data qualifying under the 
query; this collection is called the answer set (103) of 
the query. Typically, the database contains data about 
reat-worid entities like persons, orders, appointments 
ete.. A query is a prescription for selecting subsets from 

45 these entities, possibly combine some off them, and 
present them in a certain form. 
[0049] A messaging system or a message brokers 
like a hub where messages are streaming in, are trans- 
formed, and are streaming out Messaging systems 

so offer the passing of messages through a store-store- 
and-forward fundonality. Whereas message brokers in 
addition also alfow to reduce the connectfon costs by 
supporting the many-to-many communication principle. 
The messages whidi are streaming into the messaging 

55 system/broker are referred to as t>eing published. Mes- 
sages whfoh are streaming out of the niessaging sys- 
tem/broker are refenred to as being subscribed. A 
publication request specifies a message a certain 
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appltcation intends to offer to other interested app&ca- 
trons. i.a to subscribers. A subscription request spec- 
ifies the sut>set of all incoming messages a particular 
application is interested in, and the format in wNch it 
has to be presented to the sut)scriber. Message brokers 
also may support message dictionaries to hold meta- 
data descriptions of messages for de/eiopment pur- 
poses for instance, and administration and monitoring 
tools to manage the operation of the broker configura- 
tion. 

[0050] For example, various stock exchanges migfrt 
publish stock data periodically, i.e. the stock data is 
send to the message broker. Each stock exchange 
might use a different format to transfer its data. A sub- 
scriber has registered to all messages about IBM stock 
data exceeding $103 and requests Its delivery In XML 
(extended Markup Language) format 
[0051] Thus, a suk)scriptk)n request is similar to what 
has k>een described above as a "query" in terms of data- 
base technology. And exactly in this sense cun'ent state 
of the art messaging systems and message brokers do 
treat subscription requests. A visualization of this state 
of the art is given In Rgure 2. Expressed in database 
terms the "messages" (202) are treated as "database 
data" and the "suk>scriptions request" (201) are treated 
as "query" operating on that data filtering out the sut>- 
saibed messages (203); i.e. based on its specification 
messages are f itered. transformed and delivered to its 
requester. State-of-the-art inrplementations (for 
instance the Gryphon approach of IBM Watson 
Research) use technk^ues like variants of t)inary trees 
to represent subscrption requests and process inconv 
ing messages accordingly for filtering. 
[0052] Messaging systene and/or mesage broker 
support request^reply and/or event-t>ased communica- 
tion depending on whether the communication is initi- 
ated by the a source or a sink application. A sink asks 
the system for data and the system fulfills the request 
In event-based communication communication is 
source driven. The message is generated k>y the source 
and passed to the system for relaying to the sinks. The 
current invention applies to both communication mod- 
els. 

4.2 Further Analysis of the Publlsh-Subscribe Prob- 
lem Area 

[0053] The folkmng two problem areas can be identi- 
fied and are addressed by the current inventton. 

4.2.1 Many-Queries-Single-Data-ttem Characteristic 

[0054] Within the are of messaging systenrs typically 
many applicatfons have subscribed with a message bro- 
ker corresponding to many different queries wtvch have 
to t>e processed for each incoming message; i.a mes- 
sage subscriptfons requests con^espond to database 
queries. Thus, the situation is the opposite as in data- 



ble environments: In the tatter environments a query 
operates on a large amount of data, but in a message 
broker environmerrt a large amount of queries operate 
on a single data item. Extensive caching of messages 

5 can be helpful here, but even if applied to the cunrent sit- 
uation, the fundamental characteristKS, "relatively" 
small number of messages (database data) versus "rel- 
atively" large number of message sut>scriptions (data- 
base queries), is not reversed. Current query 

10 processing algorithms within messaging systems do not 
address this situatfon. thus, new algorithms must be 
irrvented or algorithms from other areas must be applied 
in this situation. 



[0055] In another class of message broker applica- 
tions the storage of published messages is required 
resulting in a so-called message warehouse. In this sit- 

so uation. perfbrnring the filtering outsMe of tiie datat>ase 
as befbre seems to be unnatural since the datat>ase 
functionality is already part of the overall environment 
[0056] A first step for improvement in ttiis problem 
area is to store tiie message in tiie database before saX- 

25 isfying the subscriptions. Suk)saiptions will then be 
transformed into usual datat)ase queries and the que- 
ries are run against the database to retrieve all corre- 
sponding messages. This technique might work fine in 
certain scenarios: For example, if subscriptions do rrat 

30 have to be cortsidered in real-time the broker can peri- 
odically work on the sut>scriptions. i.e. when a txjik of 
new messages has been materialized in the database. 

4.3 Inverting the Relationship of Miessage Publica- 
ns Hon and Subscription Requests 

[0057] The cunrent invoition transforms the sut)saip- 
tion problem into a datat>ase query prot)lem altowing to 
use query techniques known and optimized for many 

40 years. Even when messages are not made persistent 
on disk, query technologies according the cun'ent 
teacNng can be applied by considering messages and 
subscriptions as data in main memory datat)a8es. 
[P058] The basic approach of the current invention is 

45 to invert the relationship of message put)lfoation 
requests (treated as database data) and message sut>- 
scription requests (treated as datat>ase queries). Thus 
ttie core of tfie current invention is to treat incoming 

ingaBfflfiiwW'icatfQn rwmeste as tfatatese qtiwies »kI 

50 to treat message subscription requests as database 
data . 

[0059] Such an approach is counterintuitive as a mes- 
sage subscription inherently comprises the semantics 
of an "irx^uiry", a liter", 'question* and therefore a 
55 "query" for a specific type of information, a message. A 
message on the ottier hand Inherentiy is of the nature of 
a data element ^ it represents tfus type of information 
the subscriber is interested in and whuh will be sent to 
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the sii3scra>er. tude of message-subscriplion-requests oom- 

[0060] The currertt teaching is depicted in Rgure 3. prising a c^ery on a message qualifying under 

According the current teaching, the messaging system said query, 
or message ksroker comprises a database schema 

which reflects the possit)le types of subscriptions which 5 said messaging system t>eing characterized by 
can be requested from the message broker. This data- 
base schema may depend on the message types pub- comprising a database (301). and 
lished to the broker. Each subscription request received 

t>y the broker is transformed into a collection of tuples wherein sakJ second receiving means treating 

and stored in the database as database data (301). io said message-subscription-request as data- 

Without toss of generafity one may exploit an underiying base data and storing sakJ message-subscrip- 

relational database being one of the most popular data- tlon-request to said database (301), and 
base concepts. Nevertheless the invention may also be 

based on other data models and database systems. wherein said first receiving means treating said 
Furthermore, the database nrnist not be persistent i.a it is message-put)lication-request as a database- 
may be a main memory datat)ase in case no warehous- query (302) and retrieving from said database 
ing is required. Various mechanisms exist how to trans- a coHectkm (303) of message-subscription- 
form queries into tuples. As an example the teaching of requests qualifying under said database-query. 
F. Leymana UDH: A universal relatton system, Data & 

Knowledge Engineering 5 (1990), pp. 21 - 38 may be 20 2. Messaging system according to daim 1, 
exploited suggesting for the individual predicates a lin- 
ear representation comprising the search conjunctions wherein said second receiving means trans- 
and ttple conjunctions. This invention does only fbmfung said message-subscription-request 
assume the existence of one transfbmiation technique, into a database data representation, 
which can be applied, and does not depend on a special 2S 

one chosen. 3. Messaging system according to any of above 

[0061 ] Whenever a message is published, the broker claims, 
transforms the message into a query (302). This query 

is peribmied on the sut>saiption datat)ase and its wherein said first receiving means transforming 

answer set is the collection of sut>scriptions under which 30 said message-pubiication-request into a data- 

the message qualifies (303). The applications having base-query, 
made the retrieved subscriptions, are kientified and 

receive the message in the requested format 4. Messaging system according to any of above 

claims. 

4^ Value of the Current Approach as 

wherein said first receiving means store saU 

[0062] The current invention reduces subscription message into sakJ database or into a separate 

processing as defined in these messaging environ- message-database, 
ments to query processing known since many years 

from the fieki of databases. 40 5. Messaging system according to any of above 

[0063] Existing query techniques, implementations, daims, 
and database systems can be used to perform puth 

lish/subscribe in messaging system and message \m- wherein sakf messaging system is a message 
ker environments. For a broad spectrum of business broker and/or wherein saki database is part of 
problems, no new algorithms must be invented arxl 4s a message warehouse, 
existing implementations can be reused. In warehous- 
ing environments this teachkig is much more effctent 6. Messaging system according to any of above 
than the implementations being done without query daims. 
processing technology in mind. 

so wherein sakf database is stored in main menrt- 

Clalms oryand/or on persistent memory. 



1. A messaging system comprising fvst receiving 
means tor receiving a message-publtoation-request 
comprising a message to be published, and ss 

sakI messaging system comprising a second 
receiving means for receiving one or a multi- 



7. Messaging system according to daim 6, 

wherein sakf datat>ase is a relational database 
or a hierarchical database or a networi< data- 
base or an object-oriented database or a col- 
lectkmoffiatffles. 
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8. Messaging system according to any of above 
claims, 

further comprisir^ sending means for sendirtg 
said m^sage to subscrtoers of said collection s 
of message-sut)Scription-requests. 

9. A method of processing a messagei3ublication* 
request comprising a message to t>e pidalished, and 

10 

one or a muKitude of message-subscription' 
requests comprising a query on a message 
qualifying under said query, 

said method connprising the following steps: is 

a first step of treating said message-sub- 
saiption-request as database data and 
storing said message-subscriplion-request 
to said database (301). and 20 



15. Method according to daim 14. 

wherein said database is a retationa) database 
or a hierarchical database or a networtc data- 
base or an object-oriented database or a col- 
lection of flat files. 

16. Method according to any of Claims 9 to 15. 

further comprising a third step of sending said 
message to suk)scriber5 of said collection of 
message-subsoiptionHrequests. 



a second step of treating said message- 
pubTication-request as a datat)ase-query 
(302) and retrieving from said database a 
collection (303) of message-subscript'on- 2S 
requests qualifying under said database- 
query. 



10. Method according to daim 1, 

30 

wherein said first step is preceded by a sub- 
scription-transfonTiation-step wherein said 
message-subscription-request is transformed 
into a database data representation. 

3S 

11. Method system according to claim 9 orio, 



wherein said second step is preceded k)y a 
message-transformation-step wherein said 
message-publication-request is transformed 40 
into a database<|uery. 



12. Methodaccordingtoanyof claims9to11. 



wherein said first step stores said message into 45 
said database or into a separate message- 
database. 



13. Method according to any of daim 9 to 12. 

so 

wherein said method is executed by a message 
broker and/or wherein said database is part of 
a message warehouse. 



14. Methodaccordingtoanyof daims 9 to 13. 55 

storing said database in main memory andJor 
on persistent memory. 



7 



BNSDOCID: <EP ^a959416A9JL> 



EP0959416 A2 




EP0K9 416A2 




iNSOOCiD: <EP ^0959416A:L.L> 



9 



EP0959416A2 t 




10 



